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claims currently pending in this application, including those not presently being amended, 
have been reproduced below for the Examiner's convenience. 

\1. (Four Times Amended) A user interface apparatus comprising; 

a first sensor attached to a first portion of a body of a user; 

a second sensor attached to a second portion of the user, which is different 
from the first portionA 

an estimating unit arranged to estimate a relative position of the second 
portion with respect to theVirst portion in accordance with results of detection by said first 
and second sensors; \ 

a generation unmarranged to generate action information on the basis of a 
transition of the estimated relative\position; 

a determination unit arranged to determine a user instruction corresponding 
to the generated action information; anck 

an image generating unit arranged to generate an image on the basis of said 
user instruction. \ 

2. (Unamended) The apparatus according to claim 1, wherein the first 
portion is a head. 

3. (Not Presently Amended) The apparatus according to claim 2, wherein 
the second portion is a hand. 
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4. (Not Presently Amended) The apparatus according to claim 1, wherein 
said first sensor detects a location and posture of the first portion. 

5. (Unamended) The apparatus according to claim 1, wherein said second 
sensor detects a location and posture of the second portion. 

6. (Unamended) The apparatus according to claim 1, wherein the action 
information includes information which pertains to a state change of the second portion 
with respect to a location of the first portion, and information which pertains to a location 
change velocity of the state change. 

7. (Not Presently Amended) The apparatus according to claim 1, wherein 
the action information includes information which pertains to a state change of the second 
portion with respect to a location or a location and posture of the first portion, and 
information which pertains to a location change acceleration of the state change. 

8. (Unamended) The apparatus according to claim 1, wherein the action 
information includes information which pertains to a posture of the second portion with 
respect to a posture of the first portion. 

9. (Unamended) The apparatus according to claim 1, wherein the action 
information includes information which pertains to a moving direction of a location of the 
second portion with respect to a posture of the first portion. 
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10. (Unamended) The apparatus according to claim 1, further comprising: 
means for storing a value of the relative position of the second portion with 

respect to the first portion, and a plurality of state values which are defined in advance as a 

result of transition of the value; and 

means for storing a plurality of different user instruction values 

corresponding to the plurality of state values. 



1 1 . (Not Presently Amended) The apparatus according to claim 1, wherein 
said determination unit decomposes the determined user instruction into a plurality of 
instruction operands, and outputs the operands. 



13. (Unamended) The apparatus according to claim 1, further comprising a 
third sensor for detecting a bent angle of a finger. 



16. (Not Presently Amended) The apparatus according to claim 1, further 
comprising a head-mounted display for displaying the image generated by said image 
generating unit. 




18. (Fouk Times Amended) A user interface method for outputting a user 
instruction to a predetermined apparatus or program, comprising: 
Q \ / the step of detecting a location of a first portion of a body of a user and a 

location of a second portion oYthe user, which is different from the first portion, by using 
first and second sensors attached to the user; 
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the step of estimating a relative position of the second portion with respect 
to the first portion in accordance with results of detection by the first and second sensors in 
said detecting step; 

the step V>f generating action information on the basis of a transition of the 
estimated relative position; and 

the step of aletermining a user instruction corresponding to the generated 
action information and outpu\ting the determined user instruction to the apparatus or 



program. 




29. (Fou\ Times Amended) A computer readable storage medium, which 
stores a program of a userinterface method for outputting a user instruction to a 
predetermined apparatus or program, storing: 

a program step o£ detecting a location of a first portion of a body of a user 
and a location of a second portioi\of the user, which is different from the first portion, by 
using first and second sensors attached to the user; 

a program step of estimating a relative position of the second portion with 
respect to the first portion in accordance with results of detection by the first and second 
sensors in said program step of detecting; 

a program step of generating Action information on the basis of a transition 
of the estimated relative position; and 

a program step of determining a useY instruction corresponding to the 
generated action information and outputting the determined user instruction to the 
apparatus or program. 
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